Calculation of Lagrange multipliers in the construction of maximum entropy distributions in high stochastic dimension
نویسندگان
چکیده
The research addressed here concerns the construction of the probability distribution of a random vector in high dimension using the maximum entropy (MaxEnt) principle under constraints defined by the available information. In this paper, a new algorithm, adapted to the high stochastic dimension, is proposed to identify the Lagrange multipliers introduced to take into account the constraints in the MaxEnt principle. This new algorithm is based on (1) the minimization of an appropriate convex functional and (2) the construction of the probability distribution defined as the invariant measure of an Itô Stochastic Differential Equation. The methodology is validated through an application devoted to the generation of accelerograms which are physically consistent and spectrum compatible.
منابع مشابه
Generation of spectrum - compatible accelerograms using information theory
The research addressed here is devoted to the generation of seismic accelerograms compatible with a given response spectrum and other associated properties. The time sampling of the stochastic accelerogram yields a time series represented by a random vector in high stochastic dimension. The probability density function (pdf) of this random vector is constructed using the Maximum Entropy (MaxEnt...
متن کامل16QAM Blind Equalization via Maximum Entropy Density Approximation Technique and Nonlinear Lagrange Multipliers
Recently a new blind equalization method was proposed for the 16QAM constellation input inspired by the maximum entropy density approximation technique with improved equalization performance compared to the maximum entropy approach, Godard's algorithm, and others. In addition, an approximated expression for the minimum mean square error (MSE) was obtained. The idea was to find those Lagrange mu...
متن کاملApproximate solutions of Lagrange multipliers for information-theoretic random field models
This work is concerned with the construction of approximate solutions for the Lagrange multipliers involved in information-theoretic non-Gaussian random field models. Specifically, representations of physical fields with invariance properties under some orthogonal transformations are considered. A methodology for solving the optimization problems raised by entropy maximization (for the family o...
متن کاملMaximum Entropy Estimation of Probability Distribution of Variables in Higher Dimensions from Lower Dimensional Data
A common statistical situation concerns inferring an unknown distribution Q(x) from a known distribution P(y), where X (dimension n), and Y (dimension m) have a known functional relationship. Most commonly, n ≤ m, and the task is relatively straightforward for well-defined functional relationships. For example, if Y1 and Y2 are independent random variables, each uniform on [0, 1], one can deter...
متن کاملMaximum Entropy System Models and Robust Feedback Control
We consider the problem of output feedback control of partially observed automata (finite state machines) when uncertainties in the model or observations are present. The problem is to design a feedback controller that is robust to both structural and parametric uncertainties. We develop a framework that unifies the deterministic and stochastic approaches to this problem. The framework introduc...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2013